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(57) Abstract 

Multiple users interact through a. medical ejcrt mnir ™»r nTT fo fHnhasf ay*!*!™- A fif st user sends to a second user an electronic 
notification having a pointer to a record. The notification is being delivered through push technology. The second user uses the pointer to 
retrieve the record through pull technology. The notification is being indexed in the database system as related to the record. The users can 
personalize the modality of the push and pull technologies. 
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Indexing and web-technologies control interacting with database. 



FIELD OF THE INVENTION 

The invention relates to a method for accessing, through a client-server 
architecture, multimedia data distributed across heterogeneous databases. The invention relates 
in particular to such a method within an electronic medical record (EMR) environment. 

5 

BACKGROUND ART 

The ongoing development in the medical fields of diagnostics and therapy has 
led to an ever increasing number of techniques, and to dramatic changes in the delivery of 
health care and in the payment for health care services. Medical documents have become 

10 inherently multimedia, ranging from structured written reports and free text to non- 
alphanumeric data such as medical images, video streams, physiologic monitoring signals, 
voice dictation and graphics. The result of all this is that the complexity of managed care and 
of patient information has expanded greatly. Paper- and film-based recording systems and 
isolated, individual departmental information managing systems seem to have reached the 

1 5 point that they are no longer adequate in meeting the needs of integrated care. 

OBJECT OF THE INVENTION 

Hospitals and care provider organizations need a new information model to 
communicate, distribute, and manage correlated patient information items in an efficient and 
20 cost-effective manner, while maintaining or even improving the quality of care. Therefore, it is 
an object of the invention to provide a method of managing interaction with electronic record 
databases. 

SUMMARY OF THE INVENTION 
25 To this end, the invention provides a method of interacting between multiple 

users through an electronic records database system. A first user sends to a second user an 
electronic notification having a pointer to a record. The notification is being delivered through 
a push technology. The second user uses the pointer to retrieve the record through a pull 
technology. The notification is being indexed in the database as related to the record. If the 



WO 99/42933 PCT/IB99/00240 

2 

first user sends an electronic message in response to the notification, to e.g., a third user, the 
message is indexed in the database as related to the record. Preferably, the notification is 
customized according to a specification by the second user with regard to a modality of 
reception by the second user, the specification having been stored in the database. The 

5 modality may relate to, e.g., electronic receiving equipment of the second user, or to a 
temporal relevance of the notification. 

The invention is based on the following insights. The World Wide Web (or the 
Web) is the vast collection of electronic information resources accessible on the Internet 
through a client-server architecture. A client-server computer architecture is an information 

10 processing system with a server computer that enables processing power, data files and 
program files to be shared among multiple client computers interconnected to the server 
through a network. The Web is interacted with typically using a pull technology. The term 
"pull technology" refers to the mode of interaction according to which the user clicks the links 
on the Web to request the server to send information. That is, the user has to request for each 

1 5 piece of information that he/she needs to access, typically after querying the Web. Browsing 
the Web and using bookmarks are examples of the pull model. On the other hand, "push- 
technology" is data distribution according to which selected data is delivered automatically to 
the user's computer. This type of delivery is also referred to as 4< webcasting". Delivery of data 
can be at prescribed intervals or can be based on some prescribed events. An example of push- 

20 technology is PointCast, which is an Internet service for periodically pushing selected news 
and stock quotes into a subscriber's machine. Marimba's Castanet provides a push delivery for 
updating applications as well as distributing publishing content. 

The invention now combines push-technology and pull-technology and 
automatic indexing services in a single architecture. The architecture creates an efficient 

25 procedure to manage and access the large numbers of records distributed among multiple 
locations and available in a variety of formats on a web-based networked system. The 
messaging between users is automatically indexed to keep the database up to date. For relevant 
Web-related technologies, especially as applied to the medical environment, see for example, 
U.S. patent applications Ser. No's 08/785,459 (PHA 23,217 [personalizing intranet websites]); 

30 08/871,035 

(PHA 23,255 [biometrics]); and 08/924,867 (PHA 23,273 [authentication 
&security]), incorporated herein by reference. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is explained by way of example and with reference to the 
accompanying drawings, wherein: 

Fig. 1 is a block diagram of a system architecture in the invention; 
5 Fig.2 is a workflow diagram illustrating the messaging procedure in the system. 

Throughout the figures, same reference numerals indicate similar or 
corresponding features. 

1 0 PREFERRED EMBODIMENTS 

An example of a field of application in the invention relates to medical records. 
The current trend in managing electronic medical records is towards distribution across 
networked information systems, especially as driven by the Integrated Delivery Network 
(IDN) in the healthcare industry. Tracking of the records becomes one of the largest overheads 

15 in the medical environment. Due to the huge amount of data including audio, video, graphics 
images and text reports, some or all involving mission critical criteria, current pushing 
technology is not appropriate. According to the invention, by using the Web-based 
technologies the medical specialist can subscribe to receipt of the required data. The indexing 
to those data is organized and pushed to those subscribers whenever it is available. The 

20 subscribers can set the criteria on the relevance of the data. The subscribers are notified by this 
system when the deadline to deliver the data has passed because of the unavailability of the 
data. The subscribers can be notified according to their preferences listed in a user 
personalization profile. More specifically, the user can personalize the way wherein he or she 
interacts with the system through push technology and pull technology. For example, the user 

25 can specify what information is to be received, how to get the information (pager, email, 
voice, etc.). This is illustrated below. 

Block diagram 

Fig.l is a block diagram of a system 100 according to the invention. System 
30 100 supports automatic notification and indexing services of patient records and consultation 
notes. In case of an event that needs attention from clinical personnel, system 100 notifies one 
or more specific users through push technology, for example, by means of selective 
transmission of emails that have pointers to relevant pages of medical records accessible on 
the Web. The specific user can then pull the medical records by clicking the pointers. To this 
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end, system 100 comprises client devices, e.g., devices 102 and 104, server equipment 106 and 
databases 108, 1 10 and 112. Devices 102-104 communicate with databases 108-1 12 via server 
equipment 106. Server equipment 106 has a Web server (WS) 1 14 and an application server 
(AS) 1 16. Web server 1 14 is a computer running a server program whose sole purpose is to 

5 serve document data to a client computer, such as device 102 or 104, in response to receiving a 
request for that document. Application server 1 16 is a computer that provides access to 
application software. An action specified at client device 102 or 104 can run an application on 
application server 1 16. Devices 102-104 comprise Web browsers 1 18 and 120, respectively, 
each with an appropriate GUI. Devices 102-104 comprise, for example, a desktop PC, a 

10 palmtop PC, a PDA, a wireless device, a set-top box, or any other device with Web browser 
capability, a pager, or a telephone answering machine. Database 108 comprises a 
personalization database (P-DB) that contains the user preferences and access privilege 
information as explained below. Database 110 comprises one or more clinical databases (C- 
DB) that store patient records and images. Database 1 12 comprises an indexed mail database 

15 IM-DB that contains formatted email messages and indices (pointers, links) to large, relevant 
patient data and images referred to in the email messages and archived in clinical database 
110. 

Application server 1 16 automatically keeps track of the events in databases 
108-1 12, e.g., update of medical records of specific patient. Server 116 notifies the involved 

20 clinicians with email messages (i.e. through push technology) that comprise embedded links or 
pointers to large patient data files in database 1 10 (i.e., retrievable through pull technology). 
Besides using emails for notification, application server 1 1 6 can also page or make a telephone 
call to the relevant users. The pager numbers and telephone numbers of the users are stored in 
personalization database 108. A simple memo in the form of an alphanumeric message can be 

25 sent to the receiver's pager along with source contact information, such as the phone number 
of pager number of another clinician. For voice messaging, application server 116 synthesizes 
a voice by translating textual messages into audio signals and dials the telephone numbers of 
the relevant receivers. Which way for notification is being used is, in this example, user- 
dependent and can be specified in advance by storing user-preferences in personalization 

30 database 108. 
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Workflow procedure 

Operation of system 100 is illustrated below with reference to Fig.2, discussing 
the procedural steps of electronic communication of personalized medical records for a 
clinical consultation. 

5 In step 202 an email message is constructed. For example, a patient consults a 

physician and after the patient encounter, the physician sends one or more email messages to 
one or more specific clinicians, e.g., a specialist and a nurse. The email relates to multimedia 
data, including graphics, audio and video. Such an email message contains a first part and a 
second part. The first part has a clinical statement on the patient and contains one or more 

10 links to be clicked on to retrieve relevant patient data stored in database 110. The second part 
lists action items requested by the referring physician. For example, the clinical statement of 
the email message contains observation data resulting from the consult and, in addition, a 
request for an X-ray study on the patient and pointers to previous X-ray reports and images of 
the patient relevant to the case. An action item is for receipt by a referred radiologist to 

15 perform an X-ray study on the patient and requests to send a diagnosis immediately back to 
the referring physician for prognosis. 

In step 204 the email message is delivered to the referred clinicians. There are a 
variety of ways to deliver the message, depending on, for example, the urgence of the case. 
First, the referring clinician can request system 100 to page the receiver once the message has 

20 been sent. Second, the referring clinician can specify the time to page the receiver before the 
occurrence of a certain event. For example, two hours before a scheduled surgery on the 
patient the radiologist would like to ensure the surgeon to read the diagnostic interpretation of 
the latest MRI study performed on that patient. Third, the referring physician simply sends the 
message without any specified period of notification, as in typical email use. On the other 

25 hand, a clinician can specify in personalization database 108 how long before a certain event 
he or she would like to be notified. 

In step 206 the email message is received and relevant data is retrieved. The 
referred clinician receives the email message, studies the attached observations and clicks on 
the relevant links in order to retrieve patient data of interest for review, e.g., previous 

30 diagnostic reports of the patient's X-ray studies. The referred clinician then responds to the 
request of the referring physician, e.g., by interpreting the results of the latest X-ray study on 
the patient. The formal report can be updated in database 110 using existing procedures for 
hospital information systems. However, for fast response and additional comments outside the 
formal reporting structure, the referred clinician can append summaries or comments of the 
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study to the initiator's email and forward them to the initiator and to other relevant parties. 
Email database 112 keeps an audit trail of such messages. 

In step 208, a message folder reply (RPL) is created and forwarded. The 
referred clinician composes the reply message with links to new of other relevant patient 
records in system 1 00 and delivers the message to the referring physician or forwards the 
message to the next care provider for the patient in this particular encounter according to 
procedural step 204. 
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GUI for Web Browser 

The Table presents a view of a GUI for a Web browser for display on a Web- 
enabled device 102, such as desktop PC, a palmtop PC, e.g., the Velo-1 of Philips Electronics, 
or a digital TV screen. 



Web Browse* 



Date 


From 


Subject 


Action 


Thu Jul 31 14:35 97 


Lilly Hoffinan 


Need to look at the 
possibility of surgery 


View Modality 


WedJul 30 15:15 97 


Bill Smith 


An abnormal turner, 
need pathology exam 


View Modality 


Wed Jul 3010:5 97 


James Brown 


Please look at this 
case 


View Modality 





Reply 




New 




Delete 




Audio 




Video 













MB 



Dr. Tim Grace, 

A surgery applied to this patient will remove the abnormal tumor. (From Dr. Lilly Hoffman). 
Please schedule the patient to talk to me about the detail. 

! " ORIGINAL MESSAGE ~" ' 

Dr. Lilly Hoffinan, Please look at this case and plan a surgery for this patient. (From Dr. Tim 
Grace) 

ORIGINAL MESSAGE — 

Dr. Bill Smith, please do a pathology exam. (From Dr. Tim Grace) 

. — i ORIGINAL MESSAGE 

There is an abnormal tumor, need pathology exam. (From Dr. James Brown) 

• ORIGINAL MESSAGE . 

Please do X ray examination on this patient to see if there exists any tumor. (Request from 
original physician. Dr. Tim Grace) 
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GUI has fields with labels "Date", "From", "Subject", and "Action", 
respectively. The Date Field indicates the date and time on which a specific email was sent. 
The From-Field indicates the name of the sender of the email. The Subject-Field contains the 
subject of the email. When the user clicks on the underlined subject, GUIshows the email 

5 message in a message box MB. The Action-Field contains the underlined pointer to pull 

relevant patient records from database 1 10, including diagnosis reports and images. When the 
user clicks on the pointer, the related reports and images are retrieved from database 110 and 
are presented to the user through a Web browser application or Java-based applets. 

GUI has also buttons, labeled "Reply", "New", "Delete", "Audio" and "Video", 

10 respectively. When button is clicked, the original message in the image box is attached to a 
reply message that the user can enter and send to other users. When the New-button is clicked, 
the message in the message box is cleared, and the user can enter a new message and specify 
subject and receiver. The link to the current patient case, which the user is looking at, is 
attached as the "Action" message. When the Delete-button is clicked the currently selected 

15 (i.e., viewed) message is deleted and the next message on the list is retrieved and shown in the 
message box. When the user clicks on the Audio-button, a new message will be created by 
recording the dictation from the user, employing a suitable speech-to-text conversion program, 
or the audio message is stored and forwarded as an audio message (i.e., without using speech- 
to-text conversion). When the Video-button is clicked, the user is enabled to record his/her 

20 video and/or audio data to be sent to the receiver. 
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CLAIMS: 



1 . A method of interacting between multiple users through an electronic records 
database system, wherein: 

- a first user sends to a second user an electronic notification having a pointer to a record, 
the notification is being delivered through a push technology; 

5 - the second user uses the pointer to retrieve the record through a pull technology; and 

- the notification is being indexed in the database system as related to the record. 

2. The method of claim 1 , wherein: 

- the first user sends an electronic message in response to the notification; and 
10 the message is indexed in the database system as related to the record. 

3. The method of claim 1 , wherein 

- the interacting is personalized according to a specification by the second user with 
regard to a modality of reception by the second user; and 

15 - the specification has been stored in the database system. 



4. The method of claim 3, wherein the modality relates to a capability of 

electronic receiving equipment of the second user. 

20 5. The method of claim 3, wherein the modality relates to a temporal relevance of 

the notification. 



6. A method of enabling multiple users to interact through an electronic 

multimedia records database system, the method comprising: 
25 - enabling a first user to send to a second user an electronic notification having a pointer 
to a record, 

enabling the notification to be delivered through a push technology; 

enabling the second user to use the pointer for retrieval of the record through a pull 

technology; and 
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enabling the notification to be indexed in the database system as related to the record. 
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